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(57) Abstract 

A mediod is disclosed for predicting the presence of an 
abnormal level of one or more proteins in the dotting cascade 
fiom at least one time-dependent measurement profile. At least 
one time-dependent measurement on an unknown sample (103) is 
perfonned and a respective property of ifae sample is measured over 
time so as to derive a time-dependent measurement profile (101). 
A set of a plurality of predictor variables (1 10) are defined wfaidi 
sufRcientiy define the data d die time-dq»ndent measurement 
profile (101). A model (113) is then derived that represents 
the relationship between the abnomiality and die set predictor 
variables (1 10). Subsequently, die model (1 13) is utilized to predict 
^di protein or proteins in the clotting cascade are at an abnonnal 
level, widi the prediction (120) being a better prediction dian dot 
time alone. 
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A METHOD FOR PREDICTING AN ABNORMAL LEVEL OP CLOTnNG PROTEINS 



5 




U.S. patent application 08/859,773 to Givens et al. 
filed May 21, 1997, which is a continuation of U.S. 
patent application 08/477,839 to Givens et al. filed ' 
June 7, 1995. This application also relates to U.S. 

10 patent 5,646,046 to Fischer et al, the subject matter 
of which is incorporated herein by reference. This 
application is further related to the following 
publications, the subject matter of each 
also being incorporated herein by reference: 

15 1. B. Pohl, C. Beringer, M. Bombard, F. Keller, 

The quick machine - a mathematical model for the 
extrinsic activation of coagulation, Haemostasis, 24, 
325-337 (1994) . 

20 2. J. Brandt, D. Triplett, W. Rock, E. Bovill, 

C. Arkin, Effect of lupus anticoagulants on the 
activated partial thromboplastin time. Arch Patbol Lab 
Med, lis, 109-14 (1991). 



25 interfere with the one-stage prothrombin time?, 
iraejDOstasis , 23, 19-25 (1993). 



Computerized analysis of the in vitro activation of 
30 the plasmatic clotting system, Haeinostasls , 19, 309- 
321 (1989). 

5. C. Heuck, P. Baximann, Kinetic analysis of 
the clotting system in the presence of hepeurin.and 
35 depolymerized heparin, Haeiaostasis, 21, 10-18 (1991) . 



3. 



I. Talstad, Which coagulation factors 



4. 



P. Baumann, T. Jurgensen, C. Heuck, 



6. M. Astion and P. Wilding, The application of 
backpropagation neural networks to problems in 
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pathology and laboratory medicine, Arch Pathol Lab 
Med, 116, 995-1001 (1992). 

7. M. Astion, M. Wener, R. Thomas, G. Hunder, 
5 and D. Bloch, Overtraining in neural networks that 

interpret clinical data, Cliaical Chemistry, 39, 
1998-2004 (1993). 

8. J. Furlong, M. Dupuy, and J. Heinsimer, 

10 Neural network analysis of serial cjurdiac enzyme data, 
A.J.C.P., 96, 134-141 (1991). 

9. W. Dassen, R. Mulleneers, J. Smeets, K. den 
DuLk, F. Cruz, P. Brugada, and H. Wellens, Self- 

15 leauming neural networks in electrocardiography, J. 
Electrocardiol , 23, 200-202 (1990). 

10. E. Baum and D. Haussler, What size net gives 
valid generalization? Advances in Weural In/ornation 

20 Processing Systems, Morgan Kauffman Publishers, San 
Mateo, CA, 81-90 (1989). 

11. A. Blvim, Neural Networks in C++, John Wiley 
& Sons, New York, (1992) . 

25 

12. S. Haykin, Neural Networks A Comprehensive 
Foundation, Macmillan College Publishing Company, New 
York, (1994) . 

30 13. J. Swets, Measuring the accuracy of 

diagnostic systems. Science, 240, 1285-1293 (1988). 

14. M. Zweig and 6. Campbell > Receiver-operating 
characteristic (ROC) plots : a fundamental evaluation 
35 tool in clinical medicine. Clinical Chemistry, 39, 
561-577 (1993). 
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15. D. Bluestein, L. Archer, The sensitivity, 
specificity and predictive value of diagnostic 
information: a guide for clinicians. Nurse 
Practitioner, 16, 39-45 (1991) • 

5 

16. C. Schweiger, G. Soeregi,. S. Spitzauer, G. 
Haenner, and A. Pohl, Evaluation of laboratory data 
by conventional statistics and by three types of 
neural networks. Clinical Chemistry, 39, 1966-1971 

10 (1993)- 

Blood clots are the end product of a complex 
chain reaction where proteins form an enzyme cascade 
acting as a biologic amplification system. This 

15 system ensODles relatively few molecules of initiator 
products to induce sequential activation of a series 
of inactive proteins, known as factors, culminating in 
the production of the fibrin clot. Mathematical 
models of the kinetics of the cascade's pathways have 

20 been previously proposed. 

In [1]/. a dynamic model of the extrinsic 
coagulation cascade was described where data were 
collected for 20 samples using quick percent, 
activated partial thromboplastin time (APTT) , thrombin 

25 -time (TT) , fibrinogen, factor(F) II, FV, FVIl, FX, 
anti-thrombin III (ATIII) , and factor degradation 
product (FDP) assays. These data were used, as input 
to the model and the predictive output compared to 
actual recovered prothrombin time (FT) screening assay 

30 results. The model accurately predicted the FT result 
in only 11 of 20 cases. These coagulation cascade 
models demonstrate: (1) the complexity of the clot 
formation process, and (2) the difficulty in 
associating FT clot times alone with specific 

35 conditions. 
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Thrombosis and hemostasis testing is the in vitro 
study of the ability of blood to form clots and to 
break clots in vivo > Coagulation (hemostasis) assays 
began as manual methods where clot formation was 
5 observed in a test tube either by tilting the tube or 
removing fibrin strands by a wire loop. The goal was 
to determine if a patients blood sample would clot 
after certain materials were added. It was later 
detenained that the amoxint of time from initiation of 

10 the reaction to the point of clot formation in vitro 
is related to congenital disorders, acquired 
disorders, and therapeutic monitoring. In order to 
remove the inherent variability associated with the 
subjective endpoint determinations of manual 

15 techniques, instrumentation has been developed to 
measiire clot time, based on (1) electromechanical 
properties, (2) clot elasticity, (3) light scattering, 
(4) fibrin adhesion, and (5) impedance. For light 
scattering methods, data is gathered that represents 
.20 the transmission of light through the specimen as a 
function of time (an optical time-dependent 
measurement profile) . 

Two assays, the PT and APTT, core widely used to 
screen for abnormalities in the coagulation system, 

25 although several other screening assays can be used, 
e.g. protein C, fibrinogen, protein S and/or thrombin 
time. If screening assays show an abnoxiaal result, 
one or several additional tests are needed to isolate 
the exact sotirce of the abnormality. The PT and APTT 

30 assays rely primarily upon measurement of time 

required for clot time, although some variations of 
the PT also use the amplitude of the chemge in optical 
signal in estimating fibrinogen concentration.' 

Blood coagulation is affected by administration 

35 of drugs, in addition to the vast array of internal 
factors and proteins that normally influence clot 
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formation. For example, heparin is a widely-used 
therapeutic drug that is used to prevent thrombosis 
following surgery or under other conditions, or. is 
used to combat existing thrombosis. The 
5 administration of heparin is typically monitored using 
the APTT assay, which gives a prolonged clot time in 
the presence of heparin. Clot times for PT assays are 
affected to a much smaller degree. Since a number of 
other plasma abnormalities may also cause prolonged 

10 APTT results, the ability to discriminate between 
these effectors from screening assay results may be 
clinically significant. 

Using a sigmoidal curve fit to a profile, 
Baumann, et al [4] showed that a ratio of two 

15 coefficients was unique for a select group of blood 
factor deficiencies when fibrinogen was artificially 
maintained by addition of exogenous fibrinogen to a 
fixed concentration, and that same ratio also 
correlates heparin to FII deficiency and FXa 

20 deficiencies. However, the requirement for 

artlficiaily fixed fibrinogen makes this approach 
inappropriate for analysis of clinical specimens. The 
present invention makes it possible to predict a 
congenital or acquired imbalance or therapeutic 

25 condition for clinical samples from a time-dependent 
measvirement profile without artificial manipulation of 
samples. 

The present invention was conceived of and 
developed for predicting the presence of congenital or 

30 acquired imbalances or therapeutic conditions of an 
\inknown sample based on one or more time-dependent 
measurement profiles, such as optical time-dependent 
measurement profiles, where a set of predictor 
variables are provided which define characteristics of 

35 profile, and where in turn a model is derived that 
represents the relationship between a congenital or 
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re- 
acquired imbalance or therapeutic condition arid the 
set of predictor variables (so as to, in tiirn, utilize 
this model to predict the existence of the congenital 
or acquired imbalance or therapeutic condition in the 
5 unknown sample) • 

The present invention is directed to a method and 
- appeuratus for predicting the presence of at least one 

10 congenital or acquired imbalance or therapeutic 

condition from at least one time-dependent measturement 
profile. The method and apparatus include a) 
performing at least one assay on an tinknown sample and 
measuring a respective property over time so as to 

15 derive a time-dependent measurement profile, b) 
defining a set of predictor variables which 
sufficiently define the data of the time-dependent 
profile, c) deriving a model that represents the 
relationship between a diagnostic output and the set 

20 of predictor variables, and d) utilizing the model to 
predict the existence of a congenital or acquired 
imbalance or therapeutic condition in the unknown 
sample relative to the diagnostic output. In one 
embodiment, training data is provided by performing a 

25 plurality of assays on known samples, the model is a 
multilayer perceptron, the relationship between the 
diagnostic output and the set of predictor variables 
is determined by at least one algorithm, and the at 
least one algorithm is a back propagation learning 

30 algorithm. In a second embodiment of the present 
invention, the relationship between the diagnostic 
output and the set of predictor variables is derived 
by a set of statistical equations. Also in the 

present invention, a plurality of time-dependent 

35 measxirement profiles are derived, which time-dependent 
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measurement profiles can be optical time-dependent 
measurement profiles such as ones provided by a 
automated analyzer for thrombosis and hemostasis, 
where a plurality of optical measurements are taken 
5 over time, and where the plurality of optical 

measiirements are normalized. The optical profiles can 
include one or more of a PT profile, a fibrinogen 
profile, an APTT profile, a TT profile, a protein C 
profile, a protein S profile and a plurality of other 
10 assays associated with congenital or acquired 
imbalances or therapeutic conditions. 

BRIEF DESC RTPTTQN OF THE DRAWINGS 

Figure 1 is a general neuron diagram relating to 
15 the embodiment of the present invention utilizing a 
netiral network; 

Figtire 2 is a diagram of a multilayer perceptron 
for predicting congenital or acquired imbalances or 
therapeutic conditions, relating to the neural network 
20 embodiment of the present invention; 

Figure 3 is an optical profile with first and 
second derivatives of a normal clotting sample; 

Figure 4 is an illustration of two learning 
curves ; 

25 Figure 5 is an illustration of an xinstable 

learning curve; 

Figure 6 is a graph showing a comparison of 
training and cross-validation learning curves; 

Figiire 7 is a graph showing a comparison of 
30 training error for training tolerances of 0.0 and 0.1; 
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Figure 8 is a ROC illustrating the effect of 
decision boundeury on classification; 

Figure 9 is a Table compeuring bidden layer size 
with prediction error; 

5 Figure 10 is a receiver operator characteristic 

plot related to predicting an abnormality in relation 
to Factor VIII; 

Figure 11 is a graph demonstrating the ability to 
predict actual Factor VIII activity; 

10 Figure 12 is a receiver operator characteristic 

plot related to predicting an abnormality in relation 
to Factor X; 

Figure 13 is a chart listing examples of 
predictor variables for use in the present invention; 

15 Figures 14-21 show ROC curves for neural 

networks trained to predict FII, FV, FVII, FVIII, FIX, 
FX, FXI, and FXII deficiencies from PT parameters 
alone, from APTT parameters alone, or from combined 
AFTT and PT parameters; 

20 Figure 22 shows the constituency of the training 

and cross-validation sets with regsurd to each factor 
deficiency; 

Figure 23 shows results of classification of 
coagulation factor deficiencies as determined from 
25 area under ROC ciirves; 

Figure 24 shows areas under ROC curves for three 
networks trained to classify factor deficiencies based 
on three different diagnostic cutoffs; 

Figure 25 shows results from linear regressions 
30 comparing factor concentrations estimated using neiiral 
network with measured factor concentrations; 
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Flgure 26 shows the correlation between neural 
network output and measured fibrinogen concentration 
for cross-validation data set from netxral networks 
trained to estimate fibrinogen concentration; 

5 Figure 27 shows the correlation between neural 

network output and measured FX concentration for 
cross-validation data set from neural networks trained 
to estimate FX concentration; 

Figure 28 shows SOM contour plots derived from 
10 APTT optical data for the six specimen categories; 

Figure 29 shows contour plots for self-orgemizing 
feature maps trained with FT data; 

Figure 30 shows the sensitivity, specificity, 
efficiency and predictive value of positive test (PPV) 
15 and the predictive value of negative test (NPV) , based 
on either APTT or PT parameters; 

Figure 31 is a chart illustrating key aspects of 
the present invention; 

Figure 32 is a graph of True Positive Proportion 
20 vs. False Positive Proportion for a PT assay; and 

Figure 33 is a graph of True Positive Proportion 
vs. False Positive Propoxrtion for an APTT assay. 



25 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In the present invention, both a method and 
apparatus are provided for predicting the presence of 
at least one congenital or acquired imbalance or 
therapeutic condition. As can be seen in Figure 31, 
30 one or more time-dependent measurements (101) are 

performed on an unknown sample (103) . The term **time- 
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dependent measurement" is referred to herein to 
include measurements derived from assays (e.g. PT, 
APTT, fibrinogen, protein C, protein S, TT, ATIII, 
plasminogen and factor assays) . The terms "unknown 
5 sample" and "clinical sample" refer to .a sample, such 
as one from a medical patient (lOO) , where a 
congenital or acquired imbalance or therapeutic 
condition associated with thrombosis/hemostasis is not 
known (or, if suspected, has not been confirmed) • In 

10 the present invention, a coagulation property is 

measured over time so as to derive a time-dependent 
measurement profile. In a preferred embodiment, the 
time-dependent measurement is an optical measurement 
for deriving an optical profile. For example, a PT 

15 profile, a fibrinogen profile, a TT profile, an APTT 
profile and/ or variations thereof can be provided 
where, an unknown sample is analyzed for clot 
formation based on light transmittance over time 
through the unknown sample. In another preferred 

20 embodiment, two (or more) optical profiles are 
provided, such as both a PT profile and an APTT 
profile. 

After the time-dependent measurement profiles are 
provided, a set of predictor variables are defined 

25 (110) which sufficiently define the data of the^ time- 
dependent profile. One or more predictor variables 
comprise the set. And, in one embodiment, three or 
more, and in a preferred embodiment, four or more 
predictor variables were found to desirably make up 

30 the set. it was found that the characteristics of the 
time-dependent measurement profile could best be 
defined by one or more predictor variables, including 
the minimim of the first derivative of the optical 
profile, the time index of this minimum, the minimum 

35 . of the second derivative of the optical profile, the 
time index of this minimum, the maximum of the second 
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derivative, the time index of this maximim, the 
overall change in transmittance during the time- 
dependent measurement, clotting time, slope of the 
optical profile prior to clot formation , and slope of 
5 the optical profile after clot formation* 

After defining the set of predictor variables, a 
model (113) is derived which represents the 
relationship between a congenital or acquired 
imbalance or therapeutic condition and the set of 
10 predictor variables • This model can be derived from 
a neural network in one embodiment of the present 
invention. In another embodiment, the model is 
derived via a set of statistical equations. 

Neural networks represent a branch of artificial 
15 intelligence that can be used to lesorn and model 

complex, unknown systems given some known data (115) 
from which it can train. Among the features of neural 
networks that make them an attractive alternative for 
modeling complex systems are : 

They can handle noisy data well and recognize 
patterns even when some of the input data are 
obscured or missing. 

It is unnecessary to determine what factors are 
relevant a priori since the network will 
determine during the training phase what data are 
relevant, assximing there are at least some 
meeuiingful parameters in the set. . 

Neural networks are formed from multiple layers 
of interconnected neurons like that shown in Figure 1. 
30 Each neuron has one output and receives input • .1. 
from multiple other neurons over connecting links, or 
synapses. Each synapse is associated with a synaptic 
weight, w}. An adder S or linear combiner sums the 
products of the input signals and synaptic weights 



20 1; 
2. 

25 
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The linear combiner output sujn, and 0| (a 
tbreshold which lowers or a bias which raises the 
output) cure the input to the activation function f() • 
The synaptic weights are learned by adjusting their 
5 values through a learning algorithm. 

After deriving the model (113) , whether based on 
neural networks or statistical equations, the model is 
utilized to predict (120) the existence of a 
congenital or acquired imbalance or therapeutic 

10 condition in the unknown sample relative to the time- 
dependent measiirement profile (s) . As such, a 
congenital or acquired imbalance or therapeutic 
condition can be predicted. Conditions which can be 
predicted as being abnormal in the present invention 

15 can include, among others, a) factor deficiencies, 

e.g. fibrinogen. Factors II, V, VII, VIII, IX, X, XI 
and XII, as well as ATIII, plasminogen, protein C, 
protein S, etc., b) therapeutic conditions, e.g. 
heparin, Coumadin, etc. , auid c) conditions such as 

20 lupus anticoagulant. In one embodiment of the present 
invention, the method is performed on an automated 
analyzer (90) . The time-dependent measurement 
profile, such as an optical data profile, can be 
provided automatically by the automated analyzer, 

25 where the unknown sample is automatically removed by 
an automated probe from a sample container to a test 
well, one or more reagents are automatically added to 
the test well so as to initiate the reaction within 
the sample. A property over time is automatically 

30 optically monitored so as to derive the optical 

profile. The predicted congenital or therapeutic . 
condition (120) can be automatically stored in a 
memory (122) of an automated analyzer and/ or displayed 
(124) on the automated analyzer, such as on a computer 

35 monitor, or printed out on paper. As a further 

featxire of the invention, if the predicted congenital 
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or acquired imbalance or therapeutic condition is an 
abnormal condition (126) , then one or more assays for 
confirming the existence of the abnormal condition cure 
performed on the automated analyzer. In fact, in a 

.5 preferred embodiment, the one or more confirming 

assays are automatically ordered and performed on the 
analyzer once the predicted condition is determined, 
with the results of the one or more confirming assays 
being stored in a memory (131) of the automated 

10 analyzer and/or displayed (133) on the analyzer. 
Also, where the unknown sample is from a medical 
patient, both the derived model and other patient 
medical data (95) can be used for predicting the 
imbalance/condition. If a monitoring system is used, 

15 a plurality of optical measurements at one or more 

wavelengths can be taken over time so as to derive the 
optical profile, with the optical measurements 
corresponding to changes in light scattering and/ or 
light absorption in the sample. Also, the plurality 

20 of optical measurements can each be normalized to a 
first optical measurement. If the time-dependent 
measxirement is an optical profile, this can be 
provided automatically by an analyzer, where a sample 
is automatically removed by an automated probe from a 

25 sample container to a test well, one or more reagents 
are automatically added to the test well so as to 
initiate the property ch€mges within the seunple, and 
the development of the property over time is 
automatically optically monitored so as to derive the 

30 optical data profile. And, the predictor variables 
can be a plurality of variables, three or more 
predictor variables, or more than three predictor 
variables. ^ 

35 EXAMPLE 1: Prediction of Heparin in Sample 
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This example shows a set of predictor variables 
that adequately describe screening assay optical 
profiles, develops an optimal nexiral network design, 
and determines the predictive capabilities of an 
5 abnormal condition associated with 

thrombosis/hemostasis (in this case for the detection 
of hepsurin) with a substantial and well-quantified 
test data set. 

Simplastin™ L, Platelin™ L, calci\im chloride 

10 solution (0.025 M) , imidazole buffer were obtained 
from Organon Teknika Corporation, Durham, NC, 27712, 
USA. All plasma specimens were collected in 3.2% or 
3.8% sodium citrate in the ratio of one part 
emticoagulant to nine parts whole blood. The t\ibes 

15 were centrifuged at 2000 g for 30 minutes and then 

decanted into polypropylene tubes and stored at -80fiC 
until evaluated. 757 specimens were prepared from 200 
samples. These specimens were tested by the following 
specific assays: FII, FV, FVII, FVIII, FIX, FX, FXI, 

20 FXII, heparin, fibrinogen, plasminogen, protein C, 
and AT-III. Ssonples represented normal patients, a 
variety of deficiencies, and therapeutic conditions. 
Of the specimen population 216 were positive for 
heparin determined by a heparin concentration greater 

25 than 0.05 units /ml measured with a chromogenic assay 
specific if or hepeurin. The remaining specimens, 
classified as hepar in-negative, included normal 
specimens, a variety of single or multiple factor 
deficiencies, and patients receiving other therapeutic 

30 drugs. Positive heparin samples ranged to 0.54 
units/ml. 

PT and APTT screening assays were performed on 
each specimen utilizing two automated analyzers (MDA™ 
180s) and multiple reagent and plasma vials (Organon 
35 TeJcnika Corporation, Durham NC 27712, USA ) over a 
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period of five days. When clot-based coagulation 
assays are performed by an automated optically-based 
analyzer such as the MDA 180, data are collected over 
time that represents the normalized level of light 
5 transmission through a sample as a clot forms (the 
optical profile) . As the fibrin clot forms, the 
transmission of light is decreased. The optical 
profile was stored from each test. 

The network configuration chosen, a multilayer 

10 perceptron (MLP) maps input predictor variables from 
the PT and APTT screening assays to one output 
variable (see Figure 2) which represents a single 
specified condition. A similar network was also 
employed for PT-only variables and APTT-only 

15 variables. This specific MLP consists of three 

layers: the input layer, one hidden layer, and the 
output layer. 

A normal optical profile is shown in Figure 3. 
The set of predictor variables were chosen with the 

20 intent of describing optical profiles as completely as 
possible with a minimum number of variables. They are 
summarized in Table 1 where t is time from initiation 
of reaction, T is normalized light transmission 
through the reaction mixture, and pVj^^ is the Jcth 

25 predictor veuriable of assay jf. 

The predictor variables were scaled to values 
between 0 and 1, based on the range of values observed 
for each variable for assay type k 
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The input variable set includes i|_7 for both a PT 
assay and APTT assay for each specimen. For known 
5 output variable values , heparin samples with results 
of greater than 0.05 units/ml were considered 
positive cuid assigned a value of 1 while negative 
samples were assigned a value of 0. 

10 As the ratio of training set sample to 

the number of weights in a network decreases, the 
probability of generalizing decreases, reducing the 
confidence that the network will lead to correct 
classification of future samples taken from the same 

15 distribution as the training set. Thus, small samples 
sizes, then can lead to artificially high 
classification rates. This phenomenon is known as 
overtraining. In order to achieve a true accuracy 
rate of 80%, a guideline for the number of samples in 

20 the training set is approximately five times the 

number of weights in the network. For most of this 
work, a 14-6-1 network was used, leading to an upward 
bound on the sample size of 0(450). To monitor and 
evaluate the performance of the network and its 

25 ability to generalize, a cross-validation set. is 
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processed at the end of each training epoch. This 
cross-validation set is a randomly determined subset 
of the known test set that is excluded from the 
training set. 

5 Once the input predictor variables and output 

values were determined for all specimen optical 
profiles, the 757 sets of data were randomly 
distributed into two groups: 387 were used in the 
training set and 370 were used in the cross-validation 

10 set. These same two randomly determined sets were 
used throughout all the experiments. 

All synaptic weights and threshold values were 
initialized at the beginning of each training session 
to small random niimbers. 

15 The error-correction learning rule is an 

iterative process used to update the synaptic weights 
by a method of gradient descent in which the network 
minimizes the error as pattern associations (known 
input-output pairs) in the training set are presented 

20 to the network. Each cycle through the training set 
is known as an epoch. The order or presentation of 
the pattern associations was the same for all epochs. 
The learning algorithm consists of six steps which 
make up the forward pass and the backwsurd pass . In 

25 the forward pass, the hidden layer neuron activations 
are first determined 
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h = F(iWl + 



Where b is the vector of hidden- layer neurons, 1 the 
vector of Input- layer neurons, Wl the weight matrix 
5 between the input and hidden layers, and F() the 

activation function. A logistic function is used as 
" the activation function 



Then the output-layer neurons are computed 



0 = F(hW2 + ^o) 



15 where o re{>resents the output layer, h the hidden 
layer and W2 the matrix of synapses connecting the 
hidden layer and output layers. The backward pass 
begins with the computation of the output- layer error 



20 e, = (o-d)^ 



where d is the desired output. If each element of 
is less than some predefined training error tolerance 
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vector TBjo,, than the weights are not updated during 
that pass and the process continues with the next 
pattern association. A training error tolerance of 
0.1 was used in all experiments unless otherwise 
5 specified. Otherwise, the local gradient at the 
output layer is then computed: 

10 Next, the hidden-layer local gradient is computed: 

8.-li^.h)W2g.. 

Once the hidden layer error is calculated, the second 
15 layer of weights is adjusted 

W2„ = W2^i + AW2 



20 



Where 

AW2 = i/hgo + 7AW2, 



wo 99/34208 



PCT/US98/27865 



10 



-20- 

is the learning rate, 7 is the momentum factor, and m 
is the learning iteration. The first layer of weights 
is adjusted in a similar manner 



Wl„ = Wl^i + AWl 



where 

AWl = rii& + tAWI^i 



The forward pass and backward pass are repeated for 
all of the pattern associations in the training set, 
referred to as an epoch, 1000 times • At the end of 
each epoch, the trained network is applied to the 
15 cross-validation set. 

Several methods were employed to measxire the 
performance of the network's training • Error, E, for 
each input set was defined as 

20 
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The learning curve is defined as the plot of E versus 
epoch. The percent classification, ^p, describes the 
percent of the total test set (training and cross- 
validation) that is correctly classified based on some 
5 defined decision boundcory, jS. Receiver-Operating 

Characteristic (ROC) plots have also been utilized to 
describe trained networks* ability to discriminate 
between the alternative possible outcome states. In 
these plots, measures of sensitivity and specificity 
10 are shown for a complete range of decision boundaries. 
The sensitivity, or true-positive fraction is defined 
as 



and the false-positive fraction , or (1-specificity) 
is defined as 



sensitivity = 



true positive 



true positive+ false negative 



r 



15 




false positive 



false positive+ime negative ' 



20 



These ROC plots represent a common tool for evaluating 



clinical laboratory test performance. 
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Using the test set described, experiments were 
performed to determine if the presence of heparin 
could be predicted with this method. First, 
experiments were conducted to determine optimal error- 
5 correction backpropagation learning parameters: (1) 
hidden layer size, (2) learning rate, and 
(3) momentxoD. Additional experiments were also 
conducted to compare the performance of networks based 
on PT and APTT assays alone with that of one combining 

10 the results of both, the effect of the training error 
tolerance, and the decision boundary selection. 

Figure 9 shows the effect of the hidden layer 
size on the training and cross validation error and 
the percent correct classification for the optimal 

15 decision boundaury, defined as the decision boundsury 
which yielded the lowest total number of false 
positives and false negatives from the total test set. 
As the hidden layer size is Increased, the error is 
decreased. However, the ability to generalize does 

20 not increase after a hidden layer size of 6. The most 
significant benefit in terms of both error and 
percentage correct classification is between 4 and 6. 
A hidden layer size of 6 was used for the remainder of 
the experiments. 

25 A series of experiments were conducted w£th 

ij = {0.01,0.1,0.5,0.9} and 7 = {0.0,0.1,0.5,0.9}. Figure 4 
shows the learning curves for two of the best 
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combinations of parameters. Figure 5 shows an example 
learning curve when the learning rate is so high it 
leads to oscillations and convergence to a higher £• 
In general, as 17 0 the network converged to a lower E 

5 and as y-^l, the rate of convergence improved. As 

1 , the value of E converged too increased and 

oscillations increased. In addition, as 7J-^1, ^-^l 

exacerbated the oscillations. 

Figure 6 shows a comparison of the learning curve 
10 for the training set and cross-validation set for 
i|=0.5 and 7«0.1. It is a primary concern when 
developing neural networks, and it has been previously 
shown that it is important to look not only at the 
error in the training set for each cycle, but also the 
15 cross-validation error. 

Figtire 7 shows the learning curve ijaO.S and 7«0.1 
and a learning tolerance of 0.0 and 0.1. These 
results suggest that a small learning tends to 
smoothen the convergence of the learning process. 

20 Figure 8 shows the ROC plot for networks trained 

with the predictor variables from each of the two- 
screening assays with that of. them combined. In the 
single assay cases, the hidden layer size was '3. 
While using the data from one assay does lead to some 

25 success, using the information from both assays makes 
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a significant: improvement in the ability of the 
network to correctly predict the presence of hisparin. 
This graph indicates that a 90% true positive 
proportion can be achieved with a false positive 
5 proportion of 15%. Using a single assay, a 60-70% 
true positive proportion can be achieved with a false 
positive proportion of approximately 15%. 

JEXAMPLE 2; F^LCtoj; 

10 Similsu: tests were run as in Example 1. As can 

be seen in Figures 10 and 11, two training sessions 
were conducted for predicting a Factor VIII condition 
in an. unknown sample. Figure 10 is a receiver 
operator characteristic plot related to predicting an 

15 abnormality in relation to Factor VIII. In Figure 10, 
everything below 30% activity was indicated as 
positive, and everything above 30% was indicated as 
negative. Cutoff^ values other than 30% could also be 
used. In this Example, the activity percentage has a 

20 known accuracy of approximately + or - 10%. In Figure 
11, the actual percent activity was utilized as the 
output. 

EXAMPLE 3! Factoir ^ 

25 As can be seen in Figure 12, the method of the 

present invention was mm similar to that as in 
Example 2, where here an abnormality in Factor X 
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concentratlon was predicted from unknown samples. 
Everything below 30% activity was indicated as 
positive, and everything above 30% was indicated as 
negative. Cutoff values other than 30% could also be 
5 used« 

The results of the cross-validation seuaple sets 
throughout the experiments indicate that the sample 
size was sufficient for the network to generalize. 
While the random distribution of the training and 
10 cross-validation sets were held constant throughout 
the experiments presented, other distributions have 
been used. These distributions, while all yielding 
different results, still lead to the same general 
conclusion • 

15 Kany alternatives for or additions to the set of 

predictor variables were explored. This included 
coefficients of a ciirve fitted to the data profile, 
pattern recognition, and clot time-based parameters. 
Low order functions tend to lose information due to 

20 their poor fit, and high order functions tend to lose 
information in their multiple close solutions. Clot- 
based parameters, such as clot time, slope in the 
section prior to the initiation of clot formation, and 
afterwards, are often available, but not always 

25 (because in some samples, the clot time is not 
detectable) • The successful results observed 
indicate that the set of predictor variables used are 
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ef fective for predicting congenital or acquired 
imbalances or therapeutic conditions. 

The optimization of the network learning 
algorithm's parameters made significant differences in 
5 its performance. In general, performance was best 
with low learning rates, high momentum rates, some 
small training error tolerance, and a hidden layer 
size approximately half of the size of the input 
layer. 



10 



annTTTQWAI. EXAMPLES; 

Optical measurements for APTT and FT assays were 
performed on MDA 180 instruments at a wavelength of 

15 580 nm. Plasma specimens (n= 200) included normal 
patients, patients with a variety of coagulation 
factor deficiencies and patients undergoing heparin or 
other anticoagulant therapy. Duplicate APTT and PT 
screening assays were performed on each specimen with 

20 two MDA 180s using single lots of APTT and PT 

reagents. These specimens were also analyzed using 
specific assays for FII, FV, FVII, FVIII, FIX, FX, 
FXI, FXII, heparin, fibrinogen, plasminogen, protein c 
and antithrombin-III . 



25 



Data Processing and Neural Networks 
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Optical profile data files were exported from the 
HbA 180s and processed off-line. A set of nine 
parameters was derived to describe- the timing, rate 
and magnitude of coagulation events. These parameters 
5 were calculated for all APTT and PT tests. The 
parameter set is modified slightly from that for 
Example 1. In this approach, the optical data for a 
PT or APTT assay was divided into three segments (a 
pre-coagulation segment, a coagulation segment and a 

10 post-coagulation segment) using divisions based on the . 
minimum and maximum value of the second derivative for 
changes in optical signal with respect to time. The 
parameters that were analyzed included: (1) the times 
at which the onset, midpoint and end of the 

15 coagulation phase occur (tmin2, tsdnl and tmax2} 

respectively) ; (2) mean slopes for the pre-coagulation 
phase and the post-coagulation phase (slopel and 
slopes , respectively) and the slope at the mid-point 
of coagulation {mini, the coagulation "velocity" at 

20 reaction midpoint, which is analogous to slope2) ; (3) 
terms for coagulation '^acceleration*' and 
''deceleration'' (min2 and max2, respectively); and (4) 
the magnitude of signal change dizring coagulation 
(delta) • 

25 Three different sets of data parameters were 

used as input to the neural network: (1) the nine 
parameters from PT assays, (2) the nine parsuneters 
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from APTT assays, and (3) the combined parameters 
from the APTT and PT assays. Each specimen was run 
in duplicate on two instruments, to give a total of 
approximately 800 parameter sets from the 200 
5 specimens. The total number varied slightly because of 
missing data due to insufficient sample, mechanical 
failure or unspecified failures. The data peurameter 
sets were divided into training and cross-validation 
sets randomly by specimen where all replicates for a 

10 given specimen were grouped either in thei cross- 

validation set or training set. The same training and 
cross-validation sets were used throughout this study. 
The method for training and cross-validation of the 
back-propagation neural networks has been described in 

15 relation to Example 1. Each neural network was trained 
for 1000 epochs. Training parameters were learning 
rate, 0.01; momentiam, 0.5; learning tolerance, 0.10; 
decay, 0.05; input layer size, 18 (or 9 for single 
assays); hidden layer size, 9 (or 5 for single 

20 assays) ; and output layer size, 1. Three types of 
networks were trained. These included networks that 
classified specimens as deficient or non-deficient 
based on a single diagnostic cut-off, sets of networks' 
that used diagnostic cut-offs at. different levels of 

25 the same factor, and networks trained to estimate the 
actual concentration of a specific factor. 



wo 99/34208 



PCTAJS98/27865 



-r29- 

Classification of Factor Deficiencies Based on a 
Single Diagnostic Cut-off Level 

In the first set of tests, neiiral networks were 
trained to classify plasma samples Into two groups, 
5 positive (factor-deficient) and negative (non- 
deficient) , and results were compared to classification 
based on the measured factor concentration for the 
specimens. In most testing, the diagnostic cut-off for 
defining factor deficiencies was set as 30%; that is, 

10 specimens with a measured concentration of less that 30% 
of normal for a specific factor were defined as 
deficient and those with greater than 30% activity were 
defined as non-deficient. These diagnostic cut-off 
levels were etrbitrcurily defined, but are based on 

15 clinical requirements and reagent sensitivity. The 
desired output from positive samples and negative 
samples were defined as '1' and '0', respectively; the 
actual output for each specimen was a floating point 
value, a, where 0 ^ a ^ 1. Figure 22 shows the 

20 constituency of the training and cross-validation sets 
with regaurd to each factor deficiency. Classification 
of specimens was evaluated at varying ^decision 

boundaries'* that divided the neural network outputs into 

» 

positive and negative groups. This positive or negative 
25 classification was then compared to the desired output 
(the known classification) for each input data set. 
Results were plotted as nonparametrlc receiver-operating 
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Characteristic (ROC) curves and the areas under the 
curves were computed along with their associated 
standard errors. ROC curves were also derived for APTT 
and PT clot time values for comparison. Data points on 
5 the ROC curves represent the proportion of true-positive 
and false-positive classifications at varioixs decision 
boundaries. Optimum results are obtained as the true- 
positive proportion approaches 1.0 and the false- 
positive proportion approaches 0 . 0 (upper-left corner of 
10 graph) . The optimum global measure of the ROC curve is 
an area of 1.0. 

Classification of Factor Deficiencies at Multiple 
Diagnostic Cat^off Levels 

15 A second set of networks was trained for FX 

classification in a similar manner ,to the first set 
except that the diagnostic cut-off level was varied 
(10%, 30%, and 50%). FX was chosen for this experiment 
because the data set contained a greater number of 

20 positive samples at all cut-off levels than other 
factors • 

Estimation of Factor Concentration Using Pleural 
networks 

25 A third set of networks were trained to approximate 

actual specific factor activities (FIX, FV, FVII, FVIII, 
FIX, FX, FXI and FXII) and fibrinogen levels from 
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combined PT and APTT parameters from xinknown samples. 
In these cases, the desired output of the training and 
cross-validation sets was the measured activity for a 
specific factor for each specimen and the actual output 
5 of the neural network was a predicted concentration for 
this, specific factor activity. The coefficients of 
linear regressions using the desired outputs versus the 
actual neural network outputs for the cross-validation 
set were used to describe the performance of these 
10 networks. The Pearson product moment correlation 
coefficient, r, was used to estimate the correlation 
between the two data sets. 

Classification of Factor Deficiencies Based on a 

15 Single Diagnostic Cut-off Level 

Neiaral networks were trained to classify samples as 
deficient (positive result) or non-deficient (negative 
result) for individual plasma factors, using a value of 
30% activity, as the diagnostic cut-off to define 

20 deficiencies. Results were examined graphically using 
receiver-operating curves (ROC) • These graphs plot the 
true-positive proportion (number of positives detected 
divided by the total number of positives) versus the 
false-positive proportion (number of negative specimens 

25 incorrectly diagnosed as positive divided by the total 
number of negatives) . An ROC curve is generated by 
determining true-positive and false-positive proportions 
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at different "decision boundaries" for the diagnostic 
test. For example, an ROC plot for diagnosis of FII 
deficiencies using FT clot time was generated by varying 
the decision boxindary (value of FT clot time) used to 
5 differentiate between deficient aind non-deficient 
specimens. When a short clot time is used as the 
decision boundary ; most deficient specimens can be 
identified but a significant proportion of non-deficient 
specimens may also be flagged (false-positives). When 

10 a long clot time is used as the decision boundary, the 
proportion of false-positives decreases/ but the number 
of true-positive specimens that are not diagnosed may 
also increase. Under ideal conditions, a decision 
boundary can be identified from an ROC curve that 

15 produces a very high proportion of true-positives and a 
very low proportion of false-positives. This condition 
corresponds to the upper left region of the ROC plot. 
Two related terms that are often applied to clinical 
diagnostic tests are "sensitivity" and "specificity". 

20 Sensitivity refers to the ability to detect positive 
specimens and corresponds to . the y-axis of the ROC 
plots. Specificity refers to the proportion of 
specimens diagnosed as negative which are correctly 
. identified. The ROC x-axis equals (1-specif icity) . 

25 Visual assessment of the ROC curves is one method used 
to evaluate the performance of the neural networks and 
compare them to the diagnostic power of FT and AFTT clot 
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times. Another method is to measure the diagnostic 
performeuice by using the area under the ROC curves. The 
area under the BOG curve is equivalent to an estimate of 
the probability that a randomly chosen positive specimen 
5 will have a more positive result than a randomly chosen 
negative specimen. In the event that ROC curves 
overlap, the shape of the curves as veil as the areas 
beneath them becomes important. An ROC curve 
encompassing a smaller area may be preferable to an 

10 overlapping cvirve with greater area depending on the 
desired performance for a given diagnostic system. 

Figures 14-21 show ROC curves for neural networks 
trained to predict FIX, FV, FVII, FVIII, FIX, FX, FXI, 
and FXII deficiencies from PT parameters alone, from 

15 APTT parameters alone, or from combined APTT and PT 
parameters. ROC plots based on classification using 
APTT and PT clot times are included for comparison. 
Figure 23 shows the area under these curves and their 
associated stamdard errors. 

20 Results for classification of FII deficiencies are 

shown in Figure 14. Best results were observed for 
neural networks using APTT parameters alone or combined 
with PT parameters, with area under ROC curves greater- 
than 0.99 in both cases (Figure 23). Classification 

25 based on PT or APTT clot times, or from neural networks 
using PT data alone resulted in less successful 
classification and reduced area under curves. 
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Results from classification of FV deficiencies 
showed somewhat different characteristics (Figxires 15 
and 23) . Best results were observed for classification 
from a neural network using APTT data parameters, based 
5 on visual inspection and area under the ROC curve. Less 
successful classification were obtained from neural 
networks using PT data parameters alone or combined with 
APTT data, and from PT clot time, as judged from areas 
under ROC curves. Classification based on PT clot time 

10 was qualitatively different from neural networks using 
PT data, however, and tended toward higher sensitivity 
rather than specificity. This type of pattern was 
observed for classification of several coagulation 
factors, especially factors VIII, X and XI. In 

15 situations where overlapping ROC cuarves were obtained, 
consideration of the relative value of specificity and 
sensitivity, as well as the area under ROC curves, 
becomes important in comparing diagnostic results. 

20 For several of these plasma factors, including FV, 

FVIII, FIX, FX, FXI and FXII (Figures 15, 17, 18, 19, 
20 and 21), it appeared that it would be possible to 
achieve a moderately high true-positive proportion (> 
0.6) while maintaining a low false-positive proportion 

25 (< 0.1) from nexiral networks using PT, APTT or combined 
parameters. This corresponds to a situation where a 
significant proportion of deficient specimens are not 



wo 99/34208 



PCTAJS98/278d5 



-35- 

detected (moderate sensitivity) , but those that are 
detected are correctly classified as deficient for that 
specific factor (high specificity). In contrast, using 
PT or APTT clot times it was possible for most factors 
5 to adjust decision boundaries , to identify most 
. deficiencies (true-positive proportion approaching 1.0, 
high sensitivity) , but with a relatively high rate of 
false-positives (low specificity) • This corresponds to 
a situation where most or all deficient specimens are 
10 detected, but where the specific factor deficiency is 
frequently not correctly identified. The first scenario 
involving moderate or high true-positive rates with very 
low false positive rates may be preferable in the 
diagnostic scheme shown in Figure 13. 

15 For factors II, V, IX and XII, it appeared that em 

appropriate choice of neural network gave best 
diagnostic performance, as judged from the €Lrea under 
cxirves. For factors VIII, X and XI, neural networks were 
not visibly superior to diagnosis based on clot times 

20 when areas under ROC curves were the only consideration; 
however, neural networks for these factors did provide 
better specificity. For one factor (FVII, Figure 16), 
neural network classification was less effective than 
for other factors,, at least in this test system. 

# 

25 The performance of networks using data peurameters 

from PT or APTT assays alone or in combination varied 
for different factors. For factors VIII and XII, best 
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performance (signif icamtly greater area with no overlap) 
was observed when the combined sets of APTi?-PT data 
parameters were used. For several other factors, use of 
a single parameter set provided results that were 
5 comparable to or better than the combined AFTT and PT 
parameters. A network using only APTT data parameters 
(APTT HN) was equivalent (similar area) to a network 
using combined APTT-PT data (APTT-PT NN) for FII and FX; 
and superior for FV (greater area and no overlap) • 
10 Networks using only PT parameters provided results that 
were comparable (similar area) to the combined 
parameters for FV classification and better (greater 
area and insignificant overlap) for FIX classification. 

The data for misclassif i^d positive specimens were 
15 examined more closely. Misclassif ied positive specimens 
were clustered in several categories: 1) Specimens with 
"no clot* APTT or PT results (specimens with very 
prolonged or very weak coagulation reaction for which no 
clot time can be reliably calculated) ; 2) specimens with 
20 multiple deficiencies or abnormalities; 3) specimens 
with borderline deficiencies (factor activity maarginally 
lower than the diagnostic cut-off of 30%) ; and 4) 
specimens with atypically steep slope during the pre- 
coagulation phase for APTT assays that were not 
25 chsuracteristic of other specimens in the same 
classification (FX deficiencies were not detected for 
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two specimens exhibiting this characteristic with FX 
activities of 26.8% and 16.8%, respectively). 

Classification of Factor Deficiencies at Multiple 
5 Diagnostic Cut-off Levels 

The ability of netiral networks to classify FX- 
deficient specimens was tested at varying diagnostic 
cut-offs. Areas under the ROC curves for cut-off 
levels of 10%, 30% and 50% FX activity are shown in 
0 Figure 24. Results indicate that progressively poorer 
classification (as expressed in smaller areas under R0C> 
curves) was observed as higher cut-off levels were used. 

This was true for classification based on neural 
networks or FT clot times. 

5 . 

Neural Nettfork Estimation of Factor Concentration 

Neural networks were also trained to estimate 
actual protein concentrations (as opposed to a 
positive/negative classification at a defined cut-off) 

0 for FII, FV, FVII, FVIII, FIX, FX, FXI, FXII and 
fibrinogen. Linear correlation coefficients for the 
estimated smd measured concentrations are shown in 
Figure 25 for all experiments, and plots of the 
correlation data are shown in Figure 26 for fibrinogen 

5 and Figure 27 for FX. Correlation data between PT and 
APTT clot time and measured concentrations are also 
shown in Figure 25 for comparison. 
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Example: Self "Organizing Feature Maps 

Neviral networks using self -organizing feature maps 
and learning vector quantization. were used to analyze 
optical data from clinical coagulation tests. Self- 
5 orgsuiizing feature maps using an tmsupervised learning 
algorithm were trained with data from normal donors, 
patients with abnormal levels of coagulation proteins 
and patients undergoing anticoagulant therapy. Specimen 
categories were distinguishable in these maps with 

10 varying levels of resolution. A supervised neural 
network method, learning vector quantization, was used 
to train maps to classify coagulation data. These 
networks showed sensitivity greater than 0.6 and 
specificity greater than 0.85 for detection of several 

15 factor deficiencies and heparin. 

An alternative approach to analyzing PT and APTT 
data with artificial neural networks (as set forth in 
Example 1) is by using self -organizing feature maps. 
Self -organizing feature maps contain layers of input and 

20 output neurons only and contain no hidden layers. 
Training is based on competitive learning where the 
output neurons compete with one another to be activated 
and only one output ne\iron is activated for any given 
set of inputs. Output neurons become selectively timed 

25 to certain input patterns, and data with similar 
features tend to be grouped together spatially. This 
type of neural network may use either an unsupervised or 
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supervised learning algorithm. When an unsupervised 
method is used, such as the self -organizing map (SOM) 
algorithm, iinidentif ied input patterns are presented to 
the network during training and the output for each 
5 input pattern is the coordinates of the winning neuron 
in the output layer, or map. When a supervised method 
is used, such as learning vector quantization (LVQ) , 
input patterns are . presented along with a known sample 
classification to thie network during training and the 
10 output is a unique predicted classification. The LVQ 
method is similar to SOM, except that the map is divided 
into classes, and the algorithm attempts to move outputs 
away from the boundaries between these classes. 

HDA Simplastin L (PT reagent) , HDA Platelin L (APTT 
15 reagent) and other reagents were obtained from Organon 
Teknika Corporation, Durham, NO 27712, USA, unless 
otherwise indicated. Factor-deficient plasmas for 
factor assays were obtained from Organon Teknika and 
George King Bio-Medical Corporation, Overland Peurk, 
20 Kansas 66210, USA. Additional factor-deficient plasmas 
were obtained from HRF, Raleigh, NO 27612, USA. 
Random samples, specimens from patients receiving 
heparin or oral anticoagulant therapy, and other 
specimens were obtained from \Duke University Medical 
25 Center Coagulation Laboratory. 

All testing was performed on HDA 180 coagulation 
analyzers (Organon Teknika) • Optical meas\irements for PT 
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and APTT assays were performed at a wavelength of 580 
nm. Plasma specimens (n^ 200) included normal patients, 
patients with a variety of deficiencies, and patients 
undergoing heparin or other anticoagulant therapy. 
5 Duplicate PT and APTT assays were performed on each 
specimen using two MDA 180s to give a total of 
approximately 800 parameter sets from the 200 specimens. 
The total number varied slightly because of missing data, 
due to insufficient sample, mechanical failure or 

10 unspecified failures. These specimens were also tested 
to determine the concentration of coagulation factors 
(FII, FV, FVII, FVIII, FIX, FX, FXI, FXII) heparin, and 
fibrinogen. The diagnostic cut-off for defining factor 
deficiencies was set at 30%; that is, specimens with a 

15 measured concentration of less that 30% of normal for a 
specific factor were defined as deficient and those with 
greater than 30% activity were defined as non-deficient. 
Samples were defined as positive for heparin if the 
measured heparin concentration was greater than 0.05 

20 lU/ml. 

Optical Data Processing 

Optical profile data files were exported from MDA 
180s and processed off-line. A set of nine parameters 
25 was derived to describe the timing, rate and magnitude 
of coagulation events for PT and APTT tests, as 
described previously. In this approach, the optical 
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data for a PT or APTT assay was divided into three 
segments (a pre-coagulation segment, a coagulation 
segment and a post-coagulation segment) using divisions 
based on the minimum and maxdLmum value of the second 
5 derivative for changes in optical signal with respect to 
time. Parameters included: 1) the times at which the 
onset, midpoint and end of the coagulation phase occur; 
2) mean slopes for the pre-coagulation phase and the 
post-coagulation phase and the slope at the mid-point of 
10 coagulation; 3) terms for coagulation '"acceleration" and 
** deceleration" ; and 4) the magnitude of signal change 
during coagulation. 

Self -Organizing Map Algorithm 

15 A self -organizing feature map neiaral network 

consists of input and output layers of ne\irons. The 
self -organizing map (SOM) algorithm transforms an input 
vector (a set of data parameters from PT or APTT optical 
data for a single test) to an individual output neuron 

20 whose location in the output layer, or map, corresponds 
to featiires of the input data. These features tend to 
be spatially correlated in the map. There are five 
steps in the SOM learning process: 

1. Unique weight vectors w^(0) , are randomly, chosen. 
25 2. A sample from the training set is selected. 

3. The best-miatching winning neiiron i(x) at time n, 
using the minimum-distance Euclidean criterion 
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i(x) = arg min||x(n) - Wjin) 
is identified. 

4. The weight vectors of all nexzrons are updated with 
5 the formula 



w/n + l) = 



w//7) + a(n)[x(«)-w^(4 jeN^rt) 



where a(n) is the learning rate parameter, and Nc(n} 
10 is the neighborhood function centered around the 

winning neuron i(x); both a(n) and Ng(n) vary 
dynamically during training. 

5. Steps 2 through 4 are repeated until the map 
reaches equilibrium. 

15 

The SOM tests were performed using the Self- 
Organizing Map Program Package (SOM_PAK) available from 
the Helsinki University of Technology , Laboratory of 
Computer Sciences. Two different sets of parameters 

20 were used as input to the SOMs: (1) the nine parameters 
from a PT assay, and (2) the nine parameters from the 
APTT assay. All data sets (786) were used to train the 
SOMs. h 10x10 map was trained using a hexagonal 
neighborhood in two stages, in the first stage, the map 

25 was trained for 1000 epochs (an epoch is one cycle 
through all data sets) with an initial learning rate 
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parameter of 0.5 (decreasing linearly to zero during 



training) and a neighborhood radius of 10 (decreasing 
linearly to 1 during training) • In the second stage, 
the map was trained for 10000 epochs using a learning 
5 rate parameter of 0.1 and a radius of 3. 

Learning Vector Quantization 

^ Leeorning vector quantization C^^VQ) is a supervised 
learning algorithm often used to fine-tune self- 

10 organizing feature maps in order to use them in the role 
of a pattern classifier. The classification accuracy of 
the map is improved by pulling the weight vectors away 
from the decision surfaces that demarcate the class 
borders in the topological map. There are several 

15 variations of the LVQ algorithm; the one used here is 
referred to as LVQl. The learning process is similar to 
the SOM algorithm described above, except that known 
sample classifications are included when weight vectors 
are updated (step 4) : 

20 1. Initial weight vectors v^(0] , are randomly chosen. 

2. A sample from the training set with a known 
classification is selected. 

3. The best-matching winning neuron i(x) at time h, 



using the- minimum-distance Euclidean criterion 



25 
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Is identified. 

4. The weight vectors of all nexirons are updated with 
the formula 



w/n + l) = -jw/n)-a(n) 



where is the class associated with the vector 

and is the class associated with the input vector 

X. 

10 5. Steps 2 through 4 are repeated until the map 
reaches ecpiilibrium. 

The LVQ tests were performed using the Learning 
Vector Quantization Program Package (LVQ_PAK) , also 
available from the Helsinki University of Technology, 

15 LeOsoratory of Computer Sciences. The sets of parameters 
from the APTT assay or PT assays were used for the LVQ 
networks. The data parameter sets were divided evenly 
into training and cross-validation sets rsmdomly by 
specimen, where all replicates for a given specimen were 

20 grouped either in the cross-validation set or training 
set. The same training and cross-validation sets were 
used throughout this study. The LVQ networks were 
trained to classify plasma samples into two categories, 
positive (factor-deficient specimens or specimens from 

25 patients undergoing anticoagulant therapy) and negative 
(non-deficient or no anticoagulant therapy) , and results 
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were compared to classification based on the measured 
factor concentration or therapeutic condition for the 
specimens. LVQ training was performed using 200 weight 
vectors, 10000 epochs, initial learning rate parameter 
5 of 0.5 (decreasing linearly to b) , and 7 neighbors used 
in knn-classif ication. 

LVQ networks were evaluated using sensitivity (the 
proportion of known positive specimens that were 
correctly classified as positive by the network) , 

10 . specificity (the proportion of known negative specimens 
that were correctly classified as negative by the 
network) , positive predictive value (PPV) , negative 
predictive value (NPV) and efficiency. These terms are 
defined below, where TP, TN, FP and FN correspond to 

15 true positive, true negative, false positive and false 
negative classifications, respectively. 



sensitivity 
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TP _ 

TP + FP 



TN _ 



10 



15 



20 



TN + TP 
efficiency = ^^pp^fS + W 



Self-Organizing Map Algorithm 

Self -organizing featiire maps were trained using 
optical data parameters from either PT or APTT data for 
200 specimens as input. Network output consisted of map 
coordinates for each specimen. Contour plots were 
constructed for six categories of Icnown specimen 
classifications: normal donors, specimens with heparin 
> 0.05 lU/ml, fibrinogen >600mg/dl, fibrinogen <200 
mg/dl, patients receiving oral anticoagulants, and 
2S factor-deficient specimens (specimens with <30% of 



wo 99/34208 PCT/US98/27865 

-47- 

normal activity for FII, FV, FVII, FVIII, FIX, FX, FXI, 
or FXII) • These contotir plots depict the distribution 
of specimens within a category according to their map 
coordinates. 

5 Figxire 28: Contour plots for populations of samples 

used in training a self -organizing feature map using the 
tinsupervised training method SOM based on data from APTT 
assays. Optical data parameters from 765 APTT assays 
were used to train this self -organizing feature map. 
10 The shaded areas represent the distribution of output 
neurons for specific specimen populations within the 
feature map. Each contour line represents an 
incremental step of one test result located at a given 
set of map coordinates. 

15 Figxire 28 shows SOM contoiir plots derived from APTT 

optical data for the six specimen categories. Specimens 
containing low fibrinogen and high fibrinogen were 
classified at opposite borders of the SOM with no 
overlap. Normal populations showed some overlapping 

20 with low fibrinogen, factor deficient and oral 
anticoagulated categories. Overlap between normal 
specimens and edges of the high and low fibrinogen 
populations is expected, since some proportion of 
healthy donors have fibrinogen levels that are lower or 

25 higher than normal. Overlap between mapping of normal 
specimens and factor-deficient plasmas is also not 
sxirprising, since APTT tests are sensitive to some 
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factor-def iciencles (but not others) , whereas PT assays 
are sensitive to a separate subset of factor 
deficiencies. The low fibrinogen category tended to 
overlap the factor-deficient category, consistent with 
5 our observation that many factor-deficient specimens 
also had reduced fibrinogen levels. The heparin 
category tended to overlap the high fibrinogen category, 
again consistent with measiired levels of fibrinogen for 
these specimens; Little or no overlap was observed 

10 between normal specimens and specimens containing 
heparin. Specimens from patients receiving oral 
anticoagulant therapy show significant overlap with both 
normal and heparin populations. This is consistent with 
known properties of APTT assays, which are sensitive to 

15 heparin therapy but relatively insensitive to oral 
anticoagulant therapy. 

Figure 29: Contour plots for populations of samples 
used in training a self -organizing feature map using the 
unsupervised training method SON based on optical data 
20 from 765 PT assays. Experimental details are as 
described in the Materials and Methods section and in 
Figure 28. 

Contour plots for self -organizing feature maps 
trained with PT data are shown in Figure 29. Results 
25 are similar to maps from APTT data in several respects: 
(1) high and low fibrinogen were well resolved at 
opposite sides of the map; (2) normal specimens were 
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localized in a region that overlapped low fibrinogen 
specimens slightly; (3) factor-deficient specimens were 
distributed between non-overlapping regions and regions 
that overlapped low fibrinogen and normal populations. 
5 Overlap was consistent with measured fibrinogen for some 
specimens, and with poor sensitivity of FT reagents to 
some factor deficiencies in other cases; (4) oral 
anticoagulated specimens showed some overlap with both 
normal and heparin populations; and (5) the heparinized 

10 population was distributed over a large portion of the 
map. Overlap between heparinized specimens and high 
fibrinogen populations was consistent with measured 
fibrinogen levels. The resolution of the heparin 
population is somewhat surprising, considering that FT 

15 reagents are relatively insensitive to heparin. 

These results indicate that self -organizing featiire 
maps are capable of distinguishing differences in 
optical data psurameters from AFTT and FT assays even 
when no information regarding specimen diagnosis is 
20 presented to the neural network. Resolution of specimen 
populations was vsuriable, depending on reagent 
properties and sensitivities, and on whether specimens 
belonged to a given category uniquely or to multiple 
overlapping categories. 

25 BxampA? 
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The following procediire was performed for FT assays 
(see Figtare 32) and then separately for APTT assays (see 
Figure 33) • 

For Clot Time: 

5 1. Calculate mean and standard deviation (SD) for 

clot time from assays (PT or APTT) run on aliquots from 
normal specimens (n = 79) . 

2. Calculate z-scores for clot times from the 
normal group in step from the normal group in step 1 (n 

10 =79) and a group from assays performed on aliquots from 
abnormal specimens (n»410) • The group of abnormals 
included various factor deficiencies, oral- 
anticoagulated specimens, suspected DIC specimens, and 
heparinized specimens. Z-scores are calculated by 

15 • subtracting the mean of normals from the clot time and 
then dividing the result by the SD. 

3. Determine the number of true positives, true 
negatives, false positives and false negatives if 
specimens with an absolute value of the z-score greater 

20 than X SD (where x=l,2,3,4,5,) are called positive. 

For parameters: 

1. Calculate Mean and SD for each of the nine 
parameters (slope_l, slope_3, delta, index_min_l, min_l, 
25 index jnax_2, max_2, index_min_2, min_2) from assays (PT 
or APTT) run on aliquots from normal specimens (n=79) . 
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2. Calculate z-scores for each parameter of each 
specimen from the normal group (n=79) and abnormal group 
(n«410) . 

3. Determine the number of true positives, txnie 
5 negatives, false positives and false negatives if 

specimens with an absolute value of the z-score greater 
than X SD (where x=l,2,3,4,5) for one or more of the 
parameters cure called positive. 

10 Results: 

Sensitivity and specificity for non-specific 
abnormals as a group is higher when using all parameters 
rather than the traditional clot time used alone. This 
method requires only (1) a group of known normal 

15 specimens, (2) calculation of mean and SD for each of 
the nine parameters; of the normal group and an unknown 
specimen, (3) computation of z-scores for the nine 
parameters of the unknown specimen*. 
Learning Vector Quantization 

20 Eighteen LVQ networks were trained to predict the 

presence or absence of a specific factor deficiency or 
therapeutic condition from APTT or PT optical data. 
Results for the cross-validation data are summarized in 
Figure 30. Previous studies concluded that back- 

25 propagation neural networks were capable of sensitivity 
> 0.6 while maintaining specificity >0.9 for all factors 
. except FVII using an appropriate choice of PT and APTT 
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data separately or in combination « In this study, LVQ 
networks using APTT data gave sensitivity > 0.6 with 
specificity > 0.85 for factors II, X, XI, and XII, and 
heparin. LVQ networks using PT data were able to 
5 achieve > 0«6 sensitivity while maintaining > 0.85 
specificity for Factors II, X, and XI, and heparin 
(Fig\ire 30) • Results from LVQ networks showed less 
sensitivity for prediction of FVII deficiencies, 
consistent with results from back-propagation networks. 
10 For FV, FVIII and FIX, sensitivity for predicting 
deficiencies from LVQ cross-validation sets was 
generally less (<0.35) than for factors II, X, XI and 
XII. 

It is to be understood that the invention described 
15 and illustrated herein is to be taken as a preferred 
example of the same, and that various changes in the 
method and apparatus of the invention may be resorted 
to, without departing from the spirit of the invention 
or scope of the claims. 



20 
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WE CIAIM; 

1. A method for predicting the presence of an 
abnormal level of one or more proteins in the clotting 
cascade from at least .one time-dependent measurement 

5 profile, comprising: 

a) performing at least one time-dependent 
measurement on an unknown saunple and measuring a 
respective property over time so as to derive a time- 
dependent measurement profile; 
10 b) defining a set of a pliarality of predictor ^ 

variables which sufficiently define the data of the 
time-dependent measurement profile; 

c) deriving a model that represents the 
relationship between the abnormal level of said one or 

15 more proteins in the clotting cascade and the set of 
predictor variables; and 

d) utilizing the model of step c) to predict the 
existence of the abnormal level of said one or more 
proteins in the clotting cascade and to predict which 

20 protein or proteins in the clotting cascade are said one 
or more proteins which are at an abnormal level; 

the prediction of the protein or proteins at an 
abnormal level being a better prediction than an 
subnormal clot time alone. 

25 

2. The method of claim 1, where in the prediction 
of the one or more proteins at an abnormal level, the 
specificity is equal to or greater than 0.85. 

30 3. The method of claim 2, where in the prediction 

of the one or more proteins at an ad^normal level, the 
sensitivity is greater than 0.6. , 
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4, The method of claim 2, where the one or more 
proteins predicted to be at an abnormal level, is one or 
more of Factors II, V, VII, VIII, IX, X,. XI or XII. 

5 5. The method of claim 3, where the one or more 

proteins predicted to be at an abnormal level, is one or 
more of Factors II, X, XI or XII. 

6. The method of claim 2, where in the prediction 
10 of the one or more proteins at an abnormal level, the 
sensitivity is between 0.3 and 0.8. 

7- The method of claim 6, where the one or more 
proteins predicted to be at an abnormal level is one or 
15 more of Factors VIII through XII. 

8. The method of claim 2, wherein samples with a 
measiired concentration of less than about 30% of normal 
for a specific factor axe defined as being at an 

20 abnormal level. 

9. A method according to claim 1, wherein said at 
least one time-dependent measurement prof ile is at least 
one optical profile. 

25 

10. A method according to claim 9, wherein said at 
least one optical profile is provided by an automated 
analyzer for thrombosis and hemostasis testing. 

30 

11. A method according to claim 9, wherein a 
plurality of optical measurements at one or more 
wavelengths are taken over time so as to derive said at 
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least one optical profile, said optical measurements 
corresponding to changes in light scattering and/ or 
light absorption in the unknown sample. 



12. A method according to claim 9, wherein a 
plurality of optical measurements are taken over time so' 
as to derive said at least one optical profile, and 
wherein said plurality of optical measurements are each 
10 normalized to a first optical measurement. 



13. A method according to claim 10, wherein in 
step a) said at least one optical profile is provided 

15 automatically by said analyzer, whereby said tinknown 
sample is automatically removed by an automated probe 
from a sample container to a test well, one or more 
reagents are automatically added to said test well so as 
to initiate said property changes within said sample, 

20 and the development of said property over time is 
automatically optically monitored so as to derive said 
optical data profile. 



25 14. A method according to claim 13, wherein after 

step d) , a predicted congenital or acquired imbalance or 
therapeutic condition is automatically stored in a 
memory of said automated analyzer and/ or displayed on 
said automated analyzer. 

30 

15. A method according to claim 13, wherein in 
step d) , one or more assays for confirming the existence 
of said congenital or acquired imbalance or therapeutic 
35 condition is automatically performed. 
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16. A method according to claim 15, wherein said 
one or more confirming assays sure automatically ordered 
and performed on said analyzer, with results of said one 
5 or more assays being stored In a memory of said 
automated analyzer and/or displayed on said analyzer. 



17. A method according to claim 1, further 
10 comprising: 

before step a), providing a set of data from known 
samples, which data is used in step c) for deriving said 
model. 

15 

18. A method according to claim 17, wherein said 
data from known samples is provided by performing a 
plurality of assays on said known samples. 

20 19. A method according to claim 1, wherein in step 

a) , a plurality of time-dependent measurement profiles 
are derived for use in step b) . 

2t). A method according to claim 19, wherein said 
25 plurality of time dependent measurement profiles 
includes at least two profiles from assays initiated 
with PT reagents, APTT reagents, fibrinogen reagents aind 
TT reagents. 

30 21. A method according to claim 1, wherein said 

\2nknown sample is a sample from a medical patient/ and 
wherein in step d) , both said model and additional 
patient medical data are utilized for predicting the 
existence of said congenital or acquired imbalance or 

3 5 therapeutic condition . 



wo 99/34208 



PCTAJS98/27865 



-57- 

22. A method for presenting a relationship between 
data from an assay relating to thrombosis-hemostasis on 
an iinknown sample, and data from a plurality of assays 
relating to thrombosis-hemostasis from known sample 

5 populations, comprising: 

(a) providing data from at least one time dependent 
measurement profile for each of a plurality of known 
blood samples; 

(b) performing at least one time-dependent 
10 measurement on an unknown blood sample and measxiring a 

respective property over time so as to derive at least 
one time-dependent measurement profile for said unknown 
blood sample; 

(c) transforming data from step (b) to a plurality 
15 of predictor variables which sufficiently captxires the 

information content of both the unknown blood sample 
time-dependent measurement profile and the known blood 
sample time-dependent measurement profiles; 

(d) presenting the data from said unknown blood 
20 sample time-dependent measurement profile relative to 

the data from said known blood sample time-dependent 
meas\irement profiles. 

23. The method according to claim 22, wherein said 
25 plurality of known blood samples and said unknown blood 

sample are samples of whole blood, plasma, or other 
portion of whole blood. 

24. The method according to claim 23, wherein said 
30 plurality of known blood samples are samples of which 

information is known relating to one or more intrinsic 
or extrinsic clotting factors and/or therapeutic agents. 

25. The method according to claim 22, wherein steps 
35 (c) and (d) comprise transforming a set of input 
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parameters from the tine-dependent measurement profiles 
for said known blood samples and said unknown blood 
sample, to corresponding individual output neurons whose 
location on an output map corresponds to the respective 
5 input data. 

26. The method according to claim 25, wherein said 
at least one time-dependent measurement profile 
comprises a profile from a PT assay. 

10 

27. The method according to claim 25, wherein said 
at least one time-dependent measurement profile 
comprises a profile from an APTT assay. 

15 28. The method according to claim 25, wherein said 

at least one time-dependent measurement profile is an 
optical profile and comprises a PT assay and an APTT 
assay. 

20 29. The method according to claim 22, wherein said 

at least one time-dependent measurement profile is an. 
optical profile based on optical transmittance . 

30. The method according to claim 22, wherein said 
25 plurality of known blood seuaples are samples of which 

are known the presence or absence of one or more 
abnormalities relating to at least one of fibrinogen 
level, oral, emticoagulant, heparin, and one or more 
Factor levels. 

30 

31. The method according to claim 22, wherein in 
step (d) , one or more of normal sample, presence of 
heparin, and one or more Factor deficiencies are 
presented on a PT map. 
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32* The method according to claim 22, wherein in 
step (d) , at least one of normal specimen, presence of 
heparin, sJ3normal fibrinogen, oral anticoagulant, and 
one or more Factor deficiencies are presented on an APTT 
5 map. 

33. The method according to claim 22, wherein step 
(d) further comprises: 

(i) selecting weight vectors; 

10 (ii) selecting sample from training set; 

(iii) identifying best matching winning neuron at 
a particular time; 

(iv) updating weight vectors; and 

(V) repeating steps i) through iv) tintil map 
15 reaches equilibrium. 

34. The method according to claim 22, wherein in 
step (c) , data from the time-dependent measurement 
profiles is transformed into a plurality of predictor 

20 V€uriables that characterize timing, rate and magnitude 
of changes during the time-dependent measurement 
profile, and wherein said predictor variables are used 
as input for neural networks. 

.25 35. The method according to claim 22, wherein in 

steps (a) and (b) , a plurality of one or more 
coagulation assays are perf oraed to provide said time- 
dependent measurement profiles. 

30 36. The method according to claim 25, wherein a 

plurality of maps are provided for presenting said data. 
The method according to claim 36, wherein said plurality 
of maps comprise normal sample and abnormal sample maps. 
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37. The method according to claim 36, wherein a 
plurality of maps are provided for presentation of data, 
each map trained with data from one or more coagulation 
assays. 

5 

38. The method according to claim 22, wherein said 
each of a plurality of known blood samples are normal 
samples. 

10 39. The method according to claim 22, wherein the 

definition of said predictor variables is a position in 
a self-organizing feature map, trained with data from 
said at least one time-dependent measurement profiles 
for said known blood samples. 

r 

40. The method according to claim 22, wherein the 
predictor variables are in terms of a stemdard deviation 
from a mean of at least one known blood saunple 
population, and wherein said xmknown blood sample is 

20 characterized by variation from the meeui of said known 
blood samples for each predictor variable. 

41. A method for estimating the concentration of 
one or more proteins in the clotting cascade from at 

25 least one time-dependent measurement profile, 
comprising: 

a) performing at least one time-dependent 
measturement on an unlcnown seunple and measuring a 
respective property over time so as to derive a time- 

30 dependent measiarement profile; 

b) defining a set of a plurality of predictor 
variables which sufficiently define the data of the 
time-dependent measurement profile; 

c) deriving a model that represents the 
35 relationship between the abnormal level of said one or 
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more proteins in the clotting cascade and the set of 
predictor variables; and 

d) utilizing the model of step c) to estimate the 
concentration of said one or more proteins in the 
5 clotting cascade. 
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Areas under ROC curves for three netwofte troined to classify factor deficiencies based on 
three different diagnostics cutoffs (10%. 30%. ond 50%). The orea under the ROC curve for FT 
dot lime is also included. ROC curves for APTT clot time ore not shown due to the generolly 
accepted insensitivily of APH clot time to FX (as exhibited in Table H). S£ is the stondord error 
ossodoted with the orea. . 
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Results from fineor regressions comporing factor concentrations estimated using neural, 
networks with measured factor concentrations, including the slope, intercept, ond the feoreon 
product moment correloUon coefficient (r). Peorson correlotion coeffiowrts ore oteo induded for 
linear regressions comparing APTT and PT dot times with measured factor concentrations. 
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